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I. INTRODUCTION 

In the Standard Model (SM), CP violation in weak 
interactions is parametrized by an irreducible complex 
phase in the Cabibbo-Kobayashi-Maskawa (CKM) quark 
mixing matrix P, II]- The unitarity of the CKM matrix 
is typically expressed as a triangular relationship among 
its parameters such that decay amplitudes are sensitive 
to the angles of the triangle denoted a,/?, 7. Redundant 
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measurements of the parameters of the CKM matrix pro- 
vide an important test of the SM, since violation of the 
unitarity condition would be a signature of new physics. 
The angle 7 remains the least well measured of the CKM 
angles. Tree amplitudes in i? Ar*7r decays are sen- 
sitive to 7 but are Cabibbo-suppressed relative to loop- 
order (penguin) contributions involving radiation of ei- 
ther a gluon (QCD penguins) or a photon (electroweak 
penguins or EWPs) from the loop. 

It has been shown that QCD penguin contributions 
can be eliminated by constructing a linear combination of 
B° A:*+7r" and B° A'*°7r° weak decay amplitudes 
that is pure (isospin) / = | 0, 

. . (1) 

Since a transition from / = -i to / = | is possible only via 
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A/ = 1 operators, As must be free of A/ = 0, namely 
QCD contributions. The weak phase of As,, given by 
(f>3 = -^AigiAs/As), is equal to the CKM angle 7 in 
the absence of EWP operators [3| • Here, As denotes the 
CP conjugate of the amplitude in Eq. ([T|). 

The relative magnitudes and phases of the 5° — 
K*+n^ and — >• K*°7t" amplitudes in Eq. ^ are 
measured from their interference over the available decay 
phase space (Dalitz plot or DP) to the common final state 
B'^ — > K^tt^tt'^. The phase difference between — > 
K*~^TT~ and 5° — )■ K*~7r~^ is measured in the DP anal- 
ysis of the self-conjugate final state B^ — >■ K'^tt^tt^ Q 
where the strong phases cancel. This argument is ex- 
tended to i?° — > pK decay amplitudes [g, 0| where an 
isospin decomposition of amplitudes gives 



A^ 



1 



.{pK) = ^A{B' 



p-K+)+A{B"^p''K"). (2) 



Here, the i?° p~K+ and B° p^K^ decays do not de- 
cay to a common final state preventing a direct measure- 
ment of their relative phase. The amplitudes in Eq. ^ 
do, however, interfere with the B^ — ?> K*'^n~ amplitude 
in their decays to B° X+vr^vr" and B° i^l?7r+7r" 
final states so that an indirect measurement of their rel- 
ative phase is possible. 

The CP rate asymmetries of the isospin amplitudes 
A3{K*Ti) and As{pK) have been shown to obey a sum 
rule iS], 

\As{K*^)\^ - |^|(if*7r)|2 = \As{pK)\^ - \As{pK)\\ 

(3) 

This sum rule is exact in the limit of SU(3) symmetry and 
large deviations could be an indication of new strangeness 
violating operators. Measurements of B^ — >■ K*n and 
B^ — > pK amplitudes are used to evaluate Eq. ([3]). 

We present an update of the DP analysis of the fiavor- 
specific i?° K^tt^tt'^ decay from Ref. |9| with a sam- 
ple of 454 million BB events. The isobar model used 
to parametrize the complex amplitudes of the interme- 
diate resonances contributing to the final state is pre- 
sented in Sec. [TTl The BaBAR detector and data set are 
briefly described in Sec. IHII The efficient selection of 
signal candidates is described in Sec. IIVI and the un- 
binned maximum likelihood (ML) fit performed with the 
selected events is presented in Sec. |Vl The complex am- 
plitudes of the intermediate resonances contributing to 
the i3° — >■ if+TT^TT*' decay are extracted from the result 
of the ML fit in Sec. IVII together with the accounting of 
the systematic uncertainties in Sec. IVHl Several impor- 
tant results are discussed in Sec. IVHIl Measurements of 
5° — )■ pK from this article and Ref. [5] are used to pro- 
duce a measurement of $3 using Eq. ([2]). It is shown that 
the large phase difference between B^ K*^(892)tt^ 
and -^• iir*°(892)7r° amplitudes makes a similar mea- 
surement using Eq. ([l} impossible with the available data 



set. We find that the sum rule in Eq. ([3]) holds within the 
experimental uncertainty. Additionally, we find evidence 
for a direct CP asymmetry in _B" K*^tt^ decays when 
the results of Ref. Q are combined with measurements 
in this article. The conventions and results of Ref. @ 
are summarized where necessary. Finally in Sec. IIX[ we 
summarize our results. 



II. ANALYSIS OVERVIEW 

We present a DP analysis of the K'^'k~tt^ 
decay in which we measure the magnitudes and rela- 
tive phases of five resonant amplitudes: p{n{))^ , 
/9(1450)-i^+, p{nm)-K+, if*(892)+7r-, K*{%92fT:°, 
two K-K S-waves: [K-k)'^ , {Kt:)^'^ , and a non-resonant 
(NR) contribution, allowing for CP violation. The no- 
tation for the S-waves denotes phenomenological ampli- 
tudes described by coherent superpositions of an elastic 
effective range term and the i^^o(1430) resonances p^ . 
Here, we describe the decay amplitude formalism and 
conventions used in this analysis. 

The i3° — >■ K^TT^TT^ decay amplitude is a function of 
two independent kinematic variables: we use the squares 
of the invariant masses of the pairs of particles K'^-k~ 



and K+TT°, 



and y — ra 



The total 



decay amplitude is a linear combination of k isobars, each 
having amplitude Ak given by: 



Ak 



fkiJ,x,y) dx dy 



DP 



where 



DP 



fkiJ,x,y) dx dy 



= 1. 



(4) 



(5) 



Here, Ak denotes the CP conjugate amplitude, and 

'a 'fee* ''is the complex coefficient of the isobar. The 
normalized decay dynamics of the intermediate state are 
specified by the functions fk that for a spin- J resonance 
in the K^'k~ decay channel describe the angular depen- 
dence Tk{J, X, y), Blatt-Weisskopf centrifugal barrier fac- 
tor [ll| Bk{J,x), and mass distribution of the resonance 
Lk{J,x): 

fk{J,x,y)=Tk{J,x,y) x Bk{J,x) x Lk{J,x). (6) 

The branching fractions Bk {CP averaged over i?° and 
i?°), and CP asymmetry, Acp{k) are given by: 



Bk 



Acp{k) 



\Ak 



\Ak\' 



\At 



j 

|2 



^bb(«)dp' 



a,. 



(7) 



(8) 
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Q 




-Q 



TABLE I: The angular distributions T{J,x,y), and Blatt- 
Weisskopf barrier factors B(J,x), for a resonance of spin- J 
decaying to two pseudoscalar mesons. 



Spin- J 



T{J,x,y) 



-2\p\\q\co8eH 



||p1^I'?1^(3cos^ Oh 



1) 



B{J,x) 



\±4 



9 + 3z^ + 



FIG. 1: The helicity angle {Oh) and momenta of particles 
{(i,p) in the rest frame of a resonance k. 



where iVgig is the number of 
lected from a sample of N^g i?-meson decays. The av- 
erage DP efficiency, (e)]3p is given by 



k 



E(afce«*'» +ake'^^)J^pfk{J,x,y) dx dy 

k 



(9) 



-RBW 



iJ,x) 



IvP -x-iMT{J,x)' 
Here, the mass-dependent width r(J, x) is defined by 



(10) 



T{j,x) = r 



,0 M ( \q\ 



2J+1 



B{J,xf, 



(11) 



where r° is the natural width of the resonance. 

The Gounaris-Sakurai (GS) parametrization [13] is 
used to describe the lineshape of the broad p(770)~, 
p(1450)~ and p(1700)~ resonances decaying to two pi- 



where e{x,y) is the DP dependent signal selection effi- 
ciency. 

We use the Zemach tensor formalism [l^ for the angu- 
lar distribution T( J, x, y) of a process by which a pseu- 
doscalar _B-meson produces a spin-J resonance in asso- 
ciation with a bachelor pseudoscalar meson. We define 
p and q as the momentum vectors of the bachelor par- 
ticle and resonance decay product, respectively, in the 
rest frame of the resonance k. The choice of the reso- 
nance decay product defines the helicity convention for 
each resonance where the cosine of the helicity angle is 
cos9h = p- q/{\p\\q\). We choose the resonance decay 
product with momentum q to be the tt~ for K^t:~ res- 
onances, the 7r° for tt^tt*^ resonances, and the for 
Tr^K~^ resonances (see Fig. [T]). 

The decay of a spin-J resonance into two pseudoscalars 
is damped by a Blatt-Weisskopf barrier factor, character- 
ized by the phenomenological radius R of the resonance. 
The Blatt-Weisskopf barrier factors B{J,x) are normal- 
ized to 1 when equals the pole mass M of the res- 
onance. We parametrize the barrier factors in terms of 
z — \q\R and zq = \qo\R where \qo\ is the value of \q\ 
when ^/x = M. The angular distributions and Blatt- 
Weisskopf barrier factors for the resonance spins used in 
this analysis are summarized in Table HI 

We use the relativistic Breit-Wigner (RBW) lineshape 
to describe the _fi'*(892)+'" resonances. 



L"«(J,a:) = 



1 + rfpO/M 



AP + g{x) -X- iMT{J, x) ' 



(12) 



where T{J,x) is defined in Eq. (1111) . Expressions for the 
constant d and the function g{x) in terms of M and P'^ 
are given in Ref. [l^]- The parameters of the p lineshapes, 
A'/, and P° are taken from Ref. [l3l using updated line- 
shape fits with data from e'^e" annihilation and r 
decays 

An effective-range parametrization was suggested [l3| 
for the K-K scalar amplitudes, (i^r7r)Q''' and [K-k)'^^ which 
dominate for rriK-K < 2 GeV/c^, to describe the slowly 
increasing phase as a function of the Ktt mass. We use 
the parametrization chosen in the LASS experiment fl8|, 
tuned for i3-meson decays [l0| : 



L 



LASS 



(x) 



\q\ cot Sb ~ i\q\ 

r7l*)l 



AP-x- iA/P(0, x) 



with 



cot 6? 



1 1 n 

a\q\ 2 



(13) 



(14) 
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FIG. 2: The DP of the selected data sample of 23,683 events. 
The selection criteria are described in Sec. IIVI The B° 
D decay is visible as a band near — 3.5 (GeV/c^)^. 

The remaining resonances populate the borders of the DP. 



where a is the scattering length, and r the effective range 
(see Table HH) . We impose a cutoff for the Kit S-waves so 
that L^-^^^ is given only by the second term in Eq. (fT3l) 



for > 1.8 GeV/c2. Finally, the NR K+tt-tt° ampli- 
tude is taken to be constant across the DP. 

In addition to the seven resonant amplitudes and the 
NR component described above we model the contribu- 
tions to the X+vr^Tr" final state from i?*^ — >■ I? 7r° and 
— > with a double Gaussian distribution given 

by 



1-/ , 

CTl 



-exp 



0'2 



-exp 



(Ml - yi)^ 
2a| 



(15) 



The fraction / is the relative weight of the two Gaus- 
sian distributions parametrized by the masses Mi, M2 
and widths ai, a^- The D mesons are modeled as non- 
interfering isobars and are distinct from the charmless 
signal events. 



III. THE BABAR DETECTOR AND DATA SET 

The data used in this analysis were collected with the 
BaBAR detector at the PEP-II asymmetric energy e+e~ 
storage rings between October 1999 and September 2007. 
This corresponds to an integrated luminosity of 413 fb~^ 
or approximately N — 454 ± 5 million BB pairs taken 
on the peak of the T(4S') resonance (on resonance) and 
41 fb~^ recorded at a center-of-mass (CM) energy 40 MeV 
below (off resonance). 



TABLE II: The model for the A:+7r~7r° decay comprises 

a non-resonant (NR) amplitude and seven intermediate states 
listed below. The three lineshapes are described in the text 
and the citations reference the parameters used in the fit. 
We use the same LASS parameters [l^ for both neutral and 
charged K-e systems. 

Resonance Lineshape Parameters 



p(770)- 
p(1450)~ 
p(1700)- 

is'*(892)+ 
7i'*(892)'' 



Spin J : 
GS [14] 



GS fl4] 



GS [14] 



M 
M 

pO 

R- 
M 

R -- 



= 775.5 ± 0.6 MeV/c^ 
= 148.2 ± 0.8 MeV 

= (GeV/c)-i 

= 1409 ± 12 MeV/c^ 

= 500 ± 37 MeV 

= (GeV/c)-^ 

= 1749 ± 20 MeV/c^ 

= 235 ± 60 MeV 

= (GeV/c)-i 



RBW [19] M = 891.6 ± 0.26 MeV/c^ 
- = 50 ± 0.9 MeV 
= 3.4 (GeV/c)~^ 
= 896.1 ± 0.27 MeV/c^ 
= 50.5 ± 0.6 MeV 
= 3.4 (GeV/c)-i 



RBW [191 



R- 
M 

pO 

R -- 



Spin J = 



(_K'7r);+, {Ktt)^-,° lass [18] 



M = 1412 ± 3 MeV/c^ 
r° = 294 ± 6 MeV 
a = 2.07 ±0.10 (GeV/c) 
r = 3.32 ± 0.34 (GeV/c) 



NR 



Constant 



Non-interfering components 



D" 



D- 



DG 



DG 



Ml = 1862.3 MeV/c^ 
0-1 = 7.1 MeV 
M2 = 1860.1 MeV/c^ 
0-2 = 22.4 MeV 
/ = 0.12 

Ml = 1864.4 MeV/c^ 
0-1 = 9.9 MeV 
M2 = 1860.6 MeV/c^ 
(72 = 21.3 MeV 
/ = 0.32 



A detailed description of the BaBAR detector is given 
in Ref. Charged- particle trajectories are measured 

by a five layer, double-sided silicon vertex tracker (SVT) 
and a 40 layer drift chamber (DCH) coaxial with a 
1.5 T magnetic field. Charged particle identification 
is achieved by combining the information from a ring- 
imaging Cherenkov device (DIRC) and the ionization en- 
ergy loss (dE/dx) measurements from the DCH and SVT. 
Photons are detected, and their energies are measured in 
a CsI(Tl) electromagnetic calorimeter (EMC) inside the 
coil. Muon candidates are identified in the instrumented 
flux return of the solenoid. We use GEANT4-based [U 
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software to simulate the detector response and account 
for the varying beam and environmental conditions. Us- 
ing this software, we generate signal and background 
Monte Carlo (MC) event samples in order to estimate 
the efficiencies and expected backgrounds in this analy- 
sis. 



IV. EVENT SELECTION AND BACKGROUNDS 



TABLE III: Fitted values of rrii and Wi which minimize cor- 
relations of AE' with the DP position. The mi,Wi have units 
of (GeV/c2)-2' 



i 


■nii (xlO"-') 







246.36 


1055.09 


1 


-2.73 


6.86 


2 


1.14 


0.66 


3 


-0.05 


-0.03 



We reconstruct — > K^tt^tt^ candidates from a 7r° 
candidate and pairs of oppositely-charged tracks that are 
required to form a good quality vertex. The charged- 
particle candidates are required to have transverse mo- 
menta above 100 MeV/c and at least 12 hits in the DCH. 
We use information from the tracking system, EMC, 
and DIRC to select charged tracks consistent with ei- 
ther a kaon or pion hypothesis. The candidate is 
built from a pair of photons, each with an energy greater 
than 50 MeV in the laboratory frame and a lateral en- 
ergy deposition profile in the EMC consistent with that 
expected for an electromagnetic shower. The invariant 
mass of each 7r° candidate, m^a must be within 3 times 
the associated mass error, tT(m^o) of the nominal tt'^ mass 
134.9766 MeV/c^ We also require | cos6';o|, the mod- 
ulus of the cosine of the angle between the decay photon 
and the 7r° momentum vector in i:^ rest frame, to be less 
than 0.95. 

A meson candidate is characterized kine- 

m atically by the energy- substituted mass toes = 

(s/2 + Pi • pB)^/Ef — and the energy difference 
AE = Eg — ^\/s, where {Eb,Pb) and {Ei,pi) are the 
four- vectors of the B candidate and the initial electron- 
positron system in the lab frame, respectively. The as- 
terisk denotes the T(4S') frame, and s is the square of 
the invariant mass of the electron-positron system. We 
require 5.2720 GeV/c^ < toes < 5.2875 GeV/c^. To avoid 
a bias in the DP from the dependence on the tt" energy 
of the resolution in AE, we introduce the dimensionless 
quantity: 



AE 9 1. 

■ A L\ + Too + mix + m2X + m^iX^ 

AE' = (16) 

W{) + WiX + W2X'^ + W3X-^ 

where a{AE) is the per event AE error and the coef- 
ficients, rriijWi given in Table Hill are determined from 
fits to signal MC in bins oi x = ™^+^- (GeV/c^)^. We 
require \AE'\ < 2.1. Following the calculation of these 
kinematic variables, each of the B candidates is refitted 
with its mass constrained to the world average value of 
the _B-meson mass [19] in order to improve the DP po- 
sition resolution and ensure that candidates occupy the 
physical region of the DP. 

Backgrounds arise primarily from random combina- 
tions in e+e^ — > qq (continuum) events. To enhance 
discrimination between signal and continuum, we use a 
neural network (NN) p3 | to combine five discriminating 



variables: the angles with respect to the beam axis of the 
B momentum and B thrust axis in the T(45') frame, the 
zcroth and second order monomials Lo,2 of the energy 
flow about the B thrust axis, and Az/a{Az), the signif- 
icance of the flight distance between the two B mesons. 
The monomials are defined by L„ — J2iPi ^ |cos0i|", 
where 9i is the angle with respect to the B thrust axis 
of the track or neutral cluster i and pi is the magnitude 
of its momentum. The sum excludes the tracks and neu- 
tral clusters comprising the B candidate. All quantities 
are calculated in the T{AS) frame. The NN is trained 
using off-resonance data and simulated signal events, all 
of which passed the selection criteria. The final sample 
of signal candidates is selected with a requirement on the 
NN output that retains 81% of the signal and rejects 90% 
of continuum events. 

Approximately 17% of the signal MC events which 
have B candidates passing all selection criteria except 
that on Toes J contain multiple B candidates. Since 
the continuum DP is modeled from the toes sideband 
(5.200 GeV/c2 < toes < 5.272 GeV/c^) of on-peak data, 
the Toes requirement is not applied in selecting the best 
B candidate. We select the candidate with the minimum 
value of 



X 



134.9766 GeV/c2 
(t(to^o) 



XVc 



(17) 



where Xvertcx ^^'^ vertex of the kinematic fit to the 
particles that form the _B-meson candidate. 

With the above selection criteria, we determine the 
average signal efficiency over the DP, (e)]3p — 21.0 ± 
0.2% with MC simulated data generated using the model 
described in Ref. @. There are 23,683 events in the data 
sample after the selection. 

Approximately 10% of the selected signal events are 
misreconstructed. Misreconstructed signal events, known 
as self-cross- feed (SCF), occur when a track or neu- 
tral cluster from the other B is assigned to the recon- 
structed signal candidate. This occurs most often for 
low-momentum tracks and neutral pious; hence the mis- 
reconstructed events are concentrated in the corners of 
the DP. Since these regions are also where the low-mass 
resonances overlap significantly with each other, it is im- 
portant to model the misreconstructed events correctly. 
We account for misreconstructed events with a resolution 
function described in Sec. IVl 
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MC events are used to study the background from 
other B decays {B background). We group the B back- 
grounds into 19 different classes with similar kinematic 
and topological properties, collecting those decays where 
less than 8 events are expected into a single generic class. 
The B background classes used in this analysis are sum- 
marized in Table IIVI When the yield of a class is varied 
in the ML fit the quoted number of events corresponds to 
the fit results, otherwise the expected numbers of selected 
events are computed by multiplying the MC selection effi- 
ciencies by the world average branching fractions [l^, [2^ 
scaled to the data set luminosity. 



The decay B° 



is flavor specific (the charge 



of the kaon identifies the B flavor), so the flavor of the 
opposite B produced in the decay of the T(4S') can be 
used as additional input in the analysis. Events where the 
opposite B flavor has been reliably determined are less 
likely to be either continuum background or SCF. A neu- 
ral network is trained using a large sample of MC events 
with ouput into 7 exclusive tagging categories identifying 
the flavor of the B meson 24] . Those events where the 
opposite B flavor could not be determined are included 
in an untagged category. Each i?" -> iir+7r~7r° decay in 
the dataset is identified with the tagging category of the 
opposite B determined from the neural network. 



TABLE IV: Summary of B background modes included in the 
fit model. The expected number of B background events for 
each mode listed includes the branching fraction and selection 
efiiciency. The D^X and X classes do not include B^ -> 
T) tt" and B° D' K+ decays which are modeled as non- 
interfering isobars. 



Class B Decay 



Events 



1 


Generic 


660 ± 122 varied 


2 


D^X 


627 ± 60 varied 


3 


D+X 


370 ± 80 varied 


4 


A"* (892)%, A"* (1430)% 


187 ± 14 


5 


K+TT--K + 


164 ±9 


6 




109 ± 13 


7 


A+^° 


65 ±3 


8 


A+tt" 


53 ±2 


9 


+ + +0 

p p , am , ajTV 


50± 13 


10 


/o(980)A+, A*+7r° 


48± 12 


11 


p+p~, a+Tv- 


27 ±3 


12 


rj'K+ 


22 ± 1 


13 


K'+p- 


21 ±6 


14 


K*°p+ 


15 ±6 


15 


K'+K- 


14± 10 


16 


P+tt" 


11 ± 2 


17 


K'+a^, K*°p° 


9±2 


18 




8± 1 


19 




8± 1 



V. THE MAXIMUM-LIKELIHOOD FIT 

We perform an unbinned extended maximum- 
likelihood fit to extract the 5° — > K^tt^tt^ event yield 
and the resonant amplitudes. The fit uses the variables 
Toes, the NN output, and the DP to discriminate 

signal from background. The selected on-resonance data 
sample consists of signal, continuum background, and B 
background components. The signal likelihood consists 
of the sum of a correctly reconstructed (truth- matched or 
TM) and SCF term. The background contributions and 
fraction of SCF events vary with the tagging category of 
the opposite B decay. We therefore separate the compo- 
nents of the fit by the tagging category of the opposite 
B decay. 

The likelihood CI for an event i in tagging category c 
is the sum of the probability densities of all components, 

CI = Nsigf^i^ [(1 - (/sCF)Dp)'PTM,i + (/sCF)Dp'PsCF,i] 
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1 



(18) 



Here, j is the B background class number and the (±) is 
evaluated to be the charge sign of the kaon in the event 
i. A complete summary of the variables in Eq. (1181) is 
given in Table IVl 

The PDFs (X = TM, SCF, qq, Bj) are the product 
of the four PDFs of the discriminating variables, c?i = 
"^ES, d2 = AE' , = NN output, and the DP, ^4 = 
{x,y}- 



(19) 



k=l 



In the fit, the DP coordinates, {x,y) are transformed to 
square DP coordinates described in Ref. ^9]. The ex- 
tended likelihood over all tagging categories is given by 



(20) 



c=l 



where N'^ is the total number of events in tagging cate- 
gory c. The parameterizations of the PDFs are described 
in Sec. EX] and Sec.lVBl 



The Dalitz Plot PDFs 



Since the decay B'^ — AT+tt tt^ is flavor-specific, the 
and -B" DP distributions are independent of each 
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TABLE V: Definitions of tlie different variables in tlie likeliliood function given in Eq. ([18 



Variable Definition 

A'sig total number of K^n^Tv^' signal events in the data sample 

/sig fraction of signal events that are tagged in category c 

(/scf)dp fraction of SCF events in tagging category c, averaged over the DP 

^TM,i product of PDFs of the discriminating variables used in tagging category c for TM events 

^scF,i product of PDFs of the discriminating variables used in tagging category c for SCF events 

number of continuum events that are tagged in category c 

Aqq parametrizes a possible asymmetry in continuum events 

'Pqq,i product of PDFs of the discriminating variables used in tagging category c for continuum events 

Nbj number of expected B background events in class j 

f%. fraction of B background events that are tagged in category c 

Asj parametrizes a possible asymmetry in the charged B background in class j 

Vb product of PDFs of the discriminating variables used in tagging category c for B background class j 



other and in general can differ due to CP violating ef- 
fects. The backgrounds, however, are largely indepen- 
dent of the B flavor, hence a more reliable estimate of 
their contribution is obtained by fitting the and B^ 
DP distributions simultaneously. We describe only the 
B^ DP PDF, since a change from ^ to ^ accompanied 
by the interchange of the charges of the kaon and pion 
gives the B^ PDF. Projections of the DP are shown for 
each of the invariant masses m^-^a in Fig. |3l m^+^o 
in Fig. m and mj^+^- in Fig. [5] along with the data. 



1. Signal 

The total B^ K^tt^tt^ amphtude is given by 



(21) 



where k runs over all of components in the model de- 
scribed in Sec. |lll The amplitudes and phases are mea- 
sured relative to the p{nO)~ K'^ amplitude so that the 
phases ^ p(^^o)- k+ and <&p(77o)+/f- are fixed to and the 
isobar, ap(77o)-i<-+ is fixed to 1. The TM signal DP PDF 



Ptm{x,v) = e-{x,y){l - fscF{x,y)) 



\A\' 



\Ntm\^ 



(22) 



where 



liVTMp = Re^a.a.e^(*'--*-)(TM|/,/;)Dp, (23) 



and 



(TM|/«/; 



'DP — 



DP 



'^{x,y){l- fscF{x,y))fKfadx dy. 

(24) 



Here, e{x, y) and fscF^x, y) are the DP dependent signal 
selection efficiency and SCF fraction. These are imple- 
mented as histograms in the square DP coordinates. The 
indices k, a run over all components of the signal model. 
Eq. (1^^ is evaluated numerically for the lineshapes de- 
scribed in Sec. HIl 

The PDF for signal SCF is given by 



PscF{x,y) = f-{x,y) fscpix^y) 



|A^SCFp<»i?SCF 



, (25) 



where |iVscFp is given by Eq. with the replacement 
TM ^ SCF, and 



(SCF|/,/;)dp = / e{x,y)fscFix,y)hf:dxdy. (26) 
Jdp 

Convolution with a resolution function is denoted by 
^^SCF- In contrast with TM events, a convolution is 
necessary for SCF, since mis-reconstructed events often 
incur large migrations over the DP, i.e. the reconstructed 
coordinates (xr,yr) are far from the true values {xt,yt)- 
This can correspond to a broadening of resonances by as 
much as 800 MeV. We introduce a resolution function, 
RsCY{xr,yr]Xt,yt), which represents the probability to 
reconstruct at the coordinates {xr,yr) a SCF event that 
has the true coordinate {xt,yt). The resolution function 
is normalized so that 



RscF{xr,yr\xt,yt) dxr dy,- = 1 V ixt,yt), (27) 

dp 

and is implemented as an array of 2-dimensional his- 
tograms that store the probabilities as a function of the 
DP coordinates. i?scF is convolved with the signal model 
in the expression of 'Pscf in Eq. p5|) to correct for broad- 
ening of the SCF events. 

The normalization of the total signal PDF is guaran- 
teed by the DP-averaged fraction of SCF events, 
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(/scf)dp 



J^pe{x,y) ficFi^,y)i\A\^+\A\'')dx dy 
/j3pe(x,2/)(|^|2 + \A\^)dx dy 



(28) 

This quantitiy is decay dynamics-dependent, and in 
principle must be computed iteratively. Typically, 
(/scf)dp ~ 9% converging rapidly after a small num- 
ber of fits. 



2. Background 

The continuum DP distribution is extracted from a 
combination of off-resonance data and an tties side- 
band (5.200 GeV/c2 < tties < 5.272 GeV/c^) of the 
on-resonance data from which the B background has 
been subtracted. The DP is divided into eight regions 
where different smoothing parameters are applied in or- 
der to optimally reproduce the observed wide and narrow 
structures by using a two-dimensional kernel estimation 
technique [25|. A finely binned histogram is used to de- 
scribe the peak from the narrow continuum produc- 
tion. Most B background DP PDFs are smoothed two- 
dimensional histograms obtained from MC. The back- 
grounds due to & — c decays with mesons (class 2 
in Table irv|) . are modeled with a finely binned histogram 
around the mass. 



B. Description of the Other Variables 



1 . Signal 




> 
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The TTiES distribution for TM-signal events is parame- 
terized by a modified Gaussian distribution given by 



^'sig-TM(rfi) = exp 



(di — m)^ 



2cr^ + a±{di — m)2 



(29) 



The peak of the distribution is given by m and the asym- 
metric width of the distribution a± is given by cr+ for 
di < m and (t_ for m < di. The asymmetric modula- 
tion a± is similarly given by a+ for di < m and a- for 
m < di. The parameters in Eq. are determined in 
the data fit. The mss distribution for SCF-signal events 
is a smoothed histogram produced with a Gaussian ker- 
nel estimation technique from MC. 

The AE' distribution for TM-signal is parameterized 
by the sum of a Gaussian and a first order polynomial 
PDF, 



TM 



(d2) 



-exp 



id2 



ado 



(30) 



The parameters m, cr, a given in Eq. (1301) are described 
by linear functions of a; = to^±^^ with slopes and in- 
tercepts determined in the fit in order to account for a 



FIG. 3: The m^-^o invariant mass distributions in the en- 
tire kinematic range (top) and below 1.8 GeV/c^ (bottom) for 
all selected events. The p(770)~ is visible as a broad peak 
near 0.77 GeV/c^. The data are shown as points with error 
bars. The solid histograms show the projection of the fit re- 
sult for charmless signal and D events (white), B background 
(medium) and continuum (dark), respectively. 



small residual correlation of AE' with the DP position. 
A smoothed histogram taken from MC is used for the 
SCF-signal AE' PDF. The NN PDFs for signal events 
are smoothed histograms taken from MC. 



Backqrouna 



We use the ARGUS function m 



z — cx zv 1 — 



(31) 



as the continuum tties PDF. The endpoint toes™^'' is 
fixed to 5.2897 GeV/c^ and ^ is determined in the fit. 
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mj,.^„(GeV/c^) 




m^.^^ (GeV/c^) 




FIG. 4: The m^f+^o invariant mass distributions in the en- 
tire kinematic range (top) and below 1.8 GeV/c^ (bottom) 
for all selected events. The K*{892)^ is visible as a nar- 
row peak near 0.89 GeV/c^ while the broad distribution near 
1.40 GeV/c^ is the {K-k)1+. The data are shown as points 
with error bars. The solid histograms show the projection of 
the fit result for charmless signal and D events (white), B 
background (medium) and continuum (dark), respectively. 



FIG. 5: The m^^ invariant mass distributions in the entire 
kinematic range (top) and below 1.8 GeV/c^ (bottom) for all 
selected events. The K* (892)" is visible as a narrow peak near 
0.89 GeV/c^ while the broad distribution near 1.40 GeV/c^ is 
the {K'jt)q^ . The narrow peak near 1.8 GeV/c^ is the me- 
son. The data are shown as points with error bars. The solid 
histograms show the projection of the fit result for charmless 
signal and D events (white), B background (medium) and 
continuum (dark), respectively. 



The continuum AE' PDF is a linear function with slope 
determined in the fit. The shape of the continuum NN 
distribution is correlated with the DP position and is 
described by a function that varies with the closest dis- 
tance between the point representing the event and the 
boundary of the DP Adp, 

P,^(d3;ADp) = il~d3)'''ihdl + hd3 + h). (32) 

Here, ki — qi + Pi ■ Adp where qi,Pi are determined in 
the fit. We use smoothed histograms taken from MC 
to describe ities, A_E' and NN distributions for the B 
background classes in Table HVl Projections of the mES, 



AE' and NN PDFs are shown in Fig. [H] for signal, B 
background and continuum events along with the data. 



VI. RESULTS 

The ML fit results in a charmless signal yield of 
TVsig = 3670 ± 96 (stat.) ± 94 (syst.) events and total 
branching fraction for charmless B'^ K'^7t~7t'^ decays 
of Bsig = 38.5 ± 1.0 (stat.) ± 3.9 (syst.) x lO^^. We 

find the yields for B° -)■ ifir'^ and i?° D' K+ events 
are consistent with the expectations based on their world 
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FIG. 6: Distributions of AE' (left), thes (center), and A'^A'^ output (right) for all selected events. The data are shown as 
points with error bars. The solid histograms show the projection of the fit result for charmless signal and D events (white), B 
background (medium) and continuum (dark), respectively. 



average branching fractions. The sources of systematic 
uncertainty, including those related to the composition 
of the DP, are discussed in Sec. I VIII When the fit is 
repeated starting from input parameter values randomly 
distributed within the statistical uncertainty of the values 
obtained from the ML fit for the magnitudes, and vifithin 
the [— TT, tt] interval for the phases, we observe conver- 
gence toward four minima of the negative log-likelihood 
function (NLL = —log £). The best solution is sepa- 
rated by 5.4 units of NLL (3.3 a) from the next best so- 
lution. The event yield we quote is for the best solution; 
the spread of signal yields between the four solutions is 
less than 5 events. The phases $ and CP asymme- 
tries and branching fractions determined by the ML fit 
are given for the best solution in Table IVII We quote 
the total branching fractions in Table IVII assuming all 
K* — > Ktt and p — > tt+tt^ branching fractions to be 
100% and isospin conservation in K* — Ktt decays. In 
the Appendix we list the fitted magnitudes and phases 
for the four solutions in Table IVllII and together with the 
correlation matrix for the best solution in Tables IXlllIX VI 

We measure the relative phase between the narrow 
B" K*{892)+TT- and B" K*{892fn" resonances 
despite their lack of kinematic overlap due to significant 
contributions from the 5° ^ {KTT)^^7r°, (i^7r)o+7r~ S- 
waves, i?° p{770)^ K'^ and NR components. Each 
of these components interferes with both the B^ -> 
if*(892)+7r- and B° A'*(892)°7r° resonances, provid- 
ing a mechanism for their coherence. The relative phases 
among the resonances are consequently sensitive to the 
models for their kinematic shapes. We discuss the sys- 
tematic uncertainty associated with mismodeling of the 
resonance shapes in Sec. I VIII 

The quality of the fit to the DP is appraised from a 
of 745 for 628 bins where at least 16 events exist in each 
bin. The relatively poor fit appears to be due to mis- 
modeling of the continuum background which comprises 
69% of the 23,683 events. A signal enhanced subsample 
of 3232 events is selected by requiring the signal like- 



lihood of events to be greater than 20% as determined 
by the product of the NN, AE' , and tties PDFs. Us- 
ing the signal enhanced subsample we find a of 149 
for 140 bins where at least 16 events exist in each bin. 
The excess events near 0.8 GeV/c^ seen in Fig. [5] are not 
observed in the signal enhanced subsample. The system- 
atic uncertainty associated with continuum mismodeling 
is described in Sec. IVIII 

We validate the fit model by generating 100 data sam- 
ple sized pseudo-experiments with the same isobar values 
as the best solution, and observe that the NLL of the 
data fit falls within the NLL distribution of the pseudo- 
experiments. The distributions of log-likelihood ratio, 
log{Csig/C) (see Eq. ^) are shown in Fig. H The dis- 
tributions show good agreement of the data with the 
fit model. The agreement remains good when events 
near the D° region of the DP (1.8 GeV/c^ < niK+Tr- < 
1.9 GeV/c^) are removed from the log-likelihood distri- 
bution. 



VII. SYSTEMATIC UNCERTAINTIES 

Since the amount of time required for the likelihood 
fit to converge dramatically increases with the number 
of isobar parameters to determine, we limit our isobar 
model to only those resonances with significant branching 
fractions. The dominant systematic uncertainty in this 
analysis is due to contributions from intermediate reso- 
nances not included in the isobar model. We include the 
A'*(1680)7r and tensor _ftr2(1430)7r resonances with line 
shapes described in Table Ivnl in a fit to data. The result 
of this fit is used to generate high statistics samples of 
MC including these resonances. These samples are then 
fitted with the nominal isobar model and the observed 
shifts in the isobar parameters are taken as a systematic 
uncertainty listed in the Isobar Model field in Tables IIXI 
andH We find the A:*(1680)7r and A:2*(1430)7r ampli- 
tudes each to contribute less than 1% of the signal yield. 



15 



TABLE VI: CP-averaged branching fractions Bk, phases $ and <I> for B*^ and B° decays respectively, measured relative to 
B°{B°) p{770)^K^, and CP asymmetries, Acp defined in Eq. The first error is statistical and the second is systematic. 
When the elastic range term is separated from the Kn S-wave we determine the total NR branching fraction Bnr ~ 7.6 ± 
0.5 (stat.) ± 1.0 (syst.) x 10"" and the resonant Kq (1430)7r branching fractions Bj^* (i430)+7r- = 27.8 ± 2.5 (stat.) ± 3.3 (syst.) x 
10-^ -Sk*(i43o)o^o = 7.0 ± 0.5 (stat.) ± 1.1 (syst.) x 10"^ 







xlO"^) 








Isobar 


B{ 


$ [°] 


$ n 


Acp 


p(770)-_ft:+ 


6.6 ± 


0.5 ±0.8 


(fixed) 


(fixed) 


0.20 ±0.09 ±0.08 


p(1450)-7i'+ 


2.4 ± 


1.0 ±0.6 


75 ± 19 ± 9 


126 ± 25 ± 26 


-0.10 ±0.32 ±0.09 


p(1700)-7^+ 


0.6 ± 


0.6 ± 0.4 


18 ± 36 ± 16 


50 ± 38 ± 20 


-0.36 ±0.57 ±0.23 


A'*(892) + 7r- 


8.0 ± 


1.1 ±0.8 


33 ± 22 ± 20 


39 ± 25 ± 20 


-0.29 ±0.11 ±0.02 


K*{892fn° 


3.3 ± 


0.5 ±0.4 


29 ± 18 ± 6 


17 ± 20 ± 8 


-0.15 ±0.12 ±0.04 




34.2 zt 


: 2.4 ±4.1 


-167 ± 16 ±37 


-130 ±22 ±22 


0.07 ±0.14 ±0.01 


(^vr)S%° 


8.6 ± 


1.1 ± 1.3 


13 ± 17 ± 12 


10 ± 17 ± 16 


-0.15 ±0.10 ±0.04 


NR 


2.8 ± 


0.5 ±0.4 


48 ± 14 ± 6 


90±21 ± 15 


0.10 ±0.16 ±0.08 



TABLE VII: The line shape parameters of the additional 
7^2*(1430)", J<'2*(1430)+, _ft:*(1680)° and iC*(1680)+ reso- 
nances. 



Resonance Lineshape Parameters 





Spin J 


= 1 






RBW [19| 


M = 


-- 1717 MeV/c^ 






r» = 


= 322 MeV 






R = 


1.5 (GeV)-i 


_K'*(1680)+ 


RBW [191 


M = 


= 1717 MeV/c^ 






r» = 


-- 322 MeV 






R = 


1.5 (GeV)-i 




Spin J 


= 2 




7^1(1430)" 


RBW [19] 


M = 


1432 MeV/c^ 






ro = 


= 109 MeV 






R = 


1.5 (GeV)-i 


iC2*(1430)+ 


RBW [19| 


M = 


= 1425 MeV/c^ 






r° = 


= 98.5 MeV 






R = 


1.5 (GeV)-i 



Mis-modeling of the continuum DP (CDP) distribu- 
tion is the second most significant source of systematic 
uncertainty in the isobar parameters of the signal DP 
model. Due to the limited amount of off-resonance events 
recorded at BaBAR the CDP distribution is modeled from 
the mES sideband as described in Sec. IIVI Events in the 
Toes sideband have necessarily higher momentum than 
those near the signal peak and hence have a different 
DP distribution. To quantify the effect of modeling the 
Toes on-resonance CDP with off-resonance events we use 
a high statistics sample of qq MC to create a model of 
the CDP from the toes signal region. We then generate 
100 pseudo-experiments with the toes signal region CDP 
model and fit each of these with both the on-resonance 
and off-resonance models of the CDP. The average dif- 



ference observed in the isobar parameters between fits 
with each of the CDP models is recorded in the Contin- 
uum DP field of Tables IIXI and [X] In order to quantify 
the effect of mis-modeling of the shape of the continuum 
DP with the nominal smoothing parameter, we recreate 
the continuum DP PDF with various smoothing param- 
eters. We refit the data using these alternate continuum 
DP PDFs and record the variations in the isobars in the 
PDF shape parameter field of Tables IIXI and [X] 

Other sources of systematic uncertainty include: the 
uncertainty in the masses and widths of the resonances, 
the uncertainty in the fixed B background yields, the 
mis-estimation of SCF and identification efficiencies in 
MC, and a small intrinsic bias in the fitting procedure. 
We vary the masses, widths and other resonance param- 
eters within the uncertainties quoted in Table HIl and as- 
sign the observed differences in the measured amplitudes 
as systematic uncertainties (Lineshape field in Tables HXl 
and |X]) . To estimate the systematic uncertainty due to 
fixing the B background yields, we fioat each of the B 
background contributions in a series of fits to data. We 
record the variation in the isobar parameters in the B 
background field of Tables IIXI and [X] 

The average fraction of misreconstructed signal events 
predicted by MC has been verified with fully recon- 
structed B — ^ Dp events i27|. No significant differences 
between data and the simulation are found. We estimate 
the effect of misestimating the SCF fractions in MC by 
varying their nominal values relatively by ±10% in a pair 
of fits to data. The average shift in the isobar parameters 
is recorded in the SCF fraction field of Tables lIXl and 1X1 

VIII. INTERPRETATION 

Here, we use the results of this analysis and that pre- 
sented for i?° — XgTT+TT" to construct isospin ampli- 
tudes as described by Eq. ([T|) and Eq. Individually, 
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FIG. 7: Distributions of the log-likelihood for all events 
(top) and for events excluding the D° region 1.8 GeV/c^ < 
"^A'+TT- < 1.9GeV/c^ (bottom). The data are shown as points 
with error bars. The solid histograms show the projection of 
the fit result for charmless signal and D events (white), B 
background (medium) and continuum (dark), respectively. 



the phases of these amplitudes provide sensitivity to the 
CKM angle 7 while together they have been shown to 
obey the sum rule defined in Eq. ^ in the limit of SU(3) 
symmetry. 



Measurement of 



- -{S-5 + A(j)K'7,)- 

2 A 



(33) 



Here, 



(--) 

= arctan 



V2\A 



(-r) 



A 



I, (34) 



and -4_fs-»f%o, A k^+tt- sse the isobar amplitudes given 
m Eq. dH). We define 



(-) • 



COS ( <P K'°TT° 



A(j) 



K' 



(35) 

(36) 
(37) 



Likelihood scans illustrating the measurements of 
(— ) (— ) 

$ K">-wO — K'+TT- are shown in Fig. |8J We measure 
$^.0^0 - <^K'+vr- = -22 ± 24 (stat.) ± 18 (syst.)° and 
$^^.0^0 - <^K'-7T+ = -4 ± 24 (stat.) ± 19 (syst.)° us- 
ing the helicity convention defined in Fig. [TJ We use 
A(j)K->-^ = 58 ± 33 (stat.) ± 9 (syst.)° ^ and subtract 
the mixing phase contribution 2/3 = 42.2 ± 1.8° [Hi to 
evaluate Eq. 

It is important to note that for vector resonances the 
helicity convention defines an ordering of particles in the 
final state via the angular dependence T{J,x,y) (Ta- 
ble IJ). This means that care must be taken to use a 
consistent helicity convention when evaluating an isospin 
decomposition of vector amplitudes [1^ . In this analysis 
the helicity angle for K*~^tt~ is measured between the 
and 7T~ while the helicity angle for K*^tt'^ is measured be- 
tween the 7r~ and tt*^. This results in a sign flip between 

the A k'^ttOj a k*+7t- amplitudes when Eq. ([T]) is evalu- 
ated with K*{892)7T amplitudes measured as in Table IVTl 

The A 3(K*Tr) isospin triangles described by Eq. ([T]) 
are shown in Fig. [9] for the _fir*(892)7r amplitudes mea- 
sured in Table |VT1 The destructive interference be- 
tween if*(892)7r amplitudes in the isospin decomposi- 
tion (Fig. |9]) is expected, since these amplitudes are 

penguin-dominated while ^ | is penguin-free by con- 
struction [2^. We find that As {K*tt) is consistent with 

and consequently that the uncertainty in S is too large to 
permit a measurement of $3 using iir*(892)7r amplitudes 
as originally suggested in Ref. 



1. B — >■ K*Ti decays 

The weak phase of A3 in Eq. ([1]), expressed as a func- 
tion of the phases and magnitudes of isobar amplitudes 
is given by [6|, 



2. _B — > pK decays 

It is also possible to obtain a CKM constraint using 
B — )• pK decay amplitudes as in Eq. Here, the 

p~ and p^K^ amplitudes do not decay to a common 
final state, making a direct measurement of their relative 
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FIG. 9: Isospin triangles drawn to scale for B — > K*ir decays. 
The isobar amplitudes are summarized in Table IVlnl as solu- 
tion I. Note that the isospin triangle for B decays is relatively 
fiat and A3{K*n) is consistent with 0. 





= sin( $ p-K+ - 






(39) 




= C0S( $ p-K^ - 






(40) 




= Sin( $ pOA'O - 




), 


(41) 




— COS ( <I> pO^'O — 




)■ 


(42) 



FIG. 8: Likelihood scans illustrating the measurements of 
^K'o^a - $x*+,r- = -22 ± 24 (stat.) ± 18 (syst.)° (top) and 
$jf.o.^o - "1>K*~^+ = -4 ± 24 (stat.) ± 19 (syst.)° (bottom). 
The solid (dashed) line shows the 2Alog(L) for the total (sta- 
tistical) uncertainty. 



phase impossible. Interference between and K'^ 

amplitudes and K*^'!t~ can be observed using i?° decays 
to both K^TT~TT^ and i^gTr+Tr", permitting an indirect 
measurement of their relative phase. The weak phase of 
^3 {pK) is given by Eq. ([55]) where now, 



(— ) 

= arctan 



.\Ap-K+\'~'- + V2\A 



(38) 



We use the ii'*(892)+7r amphtudc in the evaluation of 

these expressions. Likelihood scans of the phase difFer- 
(— ) (— ) 

ences ^ p-K+— ^ K'+h- are shown in Fig.|10| We mea- 
^K'+-K- = -33 ± 22 (stat.) ± 20 (syst.)° 



sure $p-/f+ 



and $ 



p+K- 



K' 



-39 ± 25 (stat.) ± 20 (syst. 



Here we define 



We use the measurements ^p«K° — ^k*+t!- — 174 ± 
28 (stat.) ± 15 (syst.)° and ^pO^o -¥^.-^+ = -148 ± 
25 (stat.) ± 16 (syst.)° given in Ref. Before evalu- 
ating Eq. psp we must account for any discrepancy in 
helicity conventions used in this analysis and Ref. [sj. 
Here we must consider the hehcity conventions used not 
only by the pK amplitudes but also the intermediate 
i4r*(892)+7r~ amplitude. In this analysis the helicity an- 
gle is measured between the tt" and K'^ for p~ am- 
plitudes while the helicity angle is measured between the 
TT^ and in Ref. It is also the case that the helicity 
angle is measured between the tt"*" and ■k~ for K*~^ de- 
cays in Ref. [5] , and is measured between the and ■k~ 
in this analysis. Since there are a total of two sign flips 
due to these differences there is no net sign flip between 
ApOx^ and Ap~K+ when Eq. ^ is evaluated using the 
measurements presented in this article and in Ref. [5| . 
We evaluate Eq. ([33| using Eq. (l38l) and produce a 

measurement oi^3 illustrated in Fig. [TT] The A i{pK) 
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FIG. 11: Likelihood scans illustrating the measurement of 
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FIG. 10: Likelihood scans illustrating the measurements of 
*p-K+ - '^K'+n- = -33 ± 22 (stat.) ± 20 (syst.)° (top) and 
^p+K- -'^K*-7r+ = -39±25 (stat.) ±20 (syst.)° (bottom). 
The solid (dashed) line shows the 2Alog(L) for the total (sta- 
tistical) uncertainty. 



-10-* 



(stat. 



)tl2 (syst.; 



The solid (dashed) line 



shows the 2Alog(I/) for the total (statistical) uncertainty. 



A3(P K) 

2 




FIG. 12: Isospin triangles drawn to scale for B — >■ pK de- 
cays. The isobar amplitudes are summarized in Table IVlnl as 
solution I and in Ref. 



isospin triangles described by Eq. are shown in Fig.fT^ 
for the B — > pK amplitudes measured in this analysis and 
Ref. [H]- In contrast to the K*^ isospin triangles (Fig. [5]) 

both A I (pK) are significantly different from permit- 
ting a measurement of $| = — 10l20 (stat.)j;22 (syst.)°. 
This measurement is defined modulo 180° (see Eq. (|55)) ) 
and we quote only the value between ±90°. The like- 
lihood constraint shown in Fig. [TT] becomes flat, since 
sufficiently large deviations of the B pK amplitudes 
will result in a flat isospin triangle and consequently an 
arbitrary value of $3. 



B. Evaluation of the amplitude sum rule 

The sum rule given in Eq. ^ motivates the definition 
of the dimensionless quantity, 

1:43 (i^V)|2- 1^3 (if*7r)|2 

S3 = — ± 1. (43) 

^ \A.^{pK)\^-\A.{pK)\^ 

The asymmetry parameter S3 will be in the limit of 
exact SU(3) symmetry. Deviations from exact SU(3) 
symmetry or contributions from new physics operators 
can be quantified, if S3 is measured to be significantly 
different from 0. We use the amplitudes and phase 
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differences amons; B° K*TT and B° pK ampli- 
tudes as described in Sec. IVIII Al to produce a likeli- 
hood scan of S3 as shown in Fig. [T31 We measure 

= 0.82t°]® (stat.)+'i';35 (syst.), consistent with 0. 
The large statistical and systematic uncertainties are due 
to the poorly measured phase differences between the pK 
and K*!: amplitudes. 




FIG. 13: Likelihood scan for E3. The sohd (dashed) hne 
shows the 2Alog(I/) for the total (statistical) uncertainty. We 
measure E3 = 0.9,2toll {sta.t.)tx^^l (syst.). 



Evidence of direct CP violation in B" 

decays 



K* 



Measurements of direct CP violation are made in both 
the analyses of B° K+tt-t:" and B° -> K^tt+tt-. 
Since these analyses are statistically independent, the 
measurements of Acp may be combined for intermediate 
resonances common to both. The combined measure- 
ment of direct CP violation for S° if*(892)+7r- de- 
cays is found to be Acp{K*+n-) = -0.24±0.07 (stat.)± 
0.02 (syst.) and is significant at 3.1 a. Likelihood scans 
illustrating the measurement of Acp{K*'^Tr^) in B'^ — > 
_ftr+7r^7r° and the combined result including the measure- 
ment in B'^ ifgTT+TT^ are shown in Fig. [HI 



IX. SUMMARY 



In summary, we analyze the DP distribution for B^ ^■ 
K'^'K~TT^ decays from a sample of 454 million BB pairs. 
We determine branching fractions, CP asymmetries and 
phase differences of seven intermediate resonances in ad- 
dition to a NR contribution. We find that the isospin 
amplitude constructed from B^ — > K*!: amplitudes is 
consistent with 0, preventing the possibility of a use- 
ful CKM constraint as originally suggested in Ref. 




-0.6 -0.5 -0.4 -0.3 -0.2 -0.1 -0 0.1 
Acp(K*(892)V) 




-0.6 -0.5 -0.4 -0.3 -0.2 -0.1 -0 0.1 
Acp(K*(892)V) 

FIG. 14: Likelihood scans for Acp{K* {fi'd2)^-iv~) using only 
the B° -> K+ TT TT analysis (top) and the combined mea- 
surement with the B''^ — > K%-k'^-k~ analysis (bottom). The 
solid (dashed) line shows the 2Alog(L) for the total (sta- 
tistical) uncertainty. We measure Acp{K*^ -k') — —0.29 ± 
0.11 (stat.) ±0.02 (syst.) (Table IVT)) in B° K+-k--k° and 
AcpiK*^^') = -0.24 ± 0.07 (stat.) ± 0.02 (syst.) when the 
measurement in — > K''1-k'^tx~ is combined. The vertical 
line highlights Acp = and the horizontal line corresponds 
to 2Alog£ = 9, i.e. 3 a. 



A similar construction made with B^ — )• pK ampli- 
tudes provides sufficient sensitivity to measure the weak 
phase of the isospin amplitude. We measure $3 = 

-10^20 (stat.)i22 (syst.)° using 5° pK amplitudes. 
Fundamentally, the sensitivity of K*tt and B'^ ^■ 

pK decay amplitudes to the CKM angle 7 is limited by 
their QCD penguin dominance [28^ . the isopin amplitude 
constructed from a linear combination of such amplitudes 
being QCD penguin free. We suggest that isospin com- 
binations of Bs — >■ K*Tr and Bg — >■ pK amplitudes, which 
are not QCD penguin dominated, will provide a much 
more sensitive CKM constraint 29]. We also produce 
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the first test of a CP rate asymmetry sum rule (Eq. ([3])) 
using isospin amplitudes. We find the violation of this 
sum rule to be = 0.82^°;^® (stat.)t?:35 (syst.), con- 
sistent with 0. A significant violation of the sum rule 
could indicate the presence of new physics operators [1] , 
making further study of the isospin amplitudes presented 
in this paper an interesting area of study. Finally, we 
find evidence of direct CP violation in — >■ K*'^'k~ 
decays shown in Fig. [H Acp{K* {d,%2)+T:-) = -0.24 ± 
0.07 (stat.) ± 0.02 (syst.), when measurements from the 
B° -> K+tt-t:^ and 3° A'Ott+tt- @ DP analyses are 
combined. 
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APPENDIX 



for k = / and, 



The results of the four solutions found in the ML fit 
are summarized in Table I Villi Only the statistical un- 
certainties are quoted in this summary. The systematic 
uncertainties are summarized in Tables IIXI and [Xj The 
CP averaged interference fractions, Iki, among the inter- 
mediate decay amplitudes are given in Table IXII for so- 
lution I, expressed as a percentage of the total charmless 
decay amplitude. Here, 



hi = 



(44) 



(45) 



for k ^ I. The Ak are the amplitudes defined in Eq. (jj]). 

The full correlation matrix for solution I is given in 
Tables Ixm IXlIIl IXTVl and|X3_The tables are separated 
by correlations among B and B decay amplitudes. 
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TABLE VIII: Summary of fit results for the four solutions. The isobar parameters a and $ are defined in Eq. 0. The 

phases $ are measured relative to B'^{B^) — > p(770)^ in degrees and the *a' are measured relative to — t- p{770)^ 
so that cip{77o)+/f- = 1- The uncertainties are statistical only. 



Amplitude 


Parameter 


Solution-I 


Solution-II 


Solution-Ill 


Solution-IV 




ANLL 


0.00 


5.43 


7.04 


12.33 




a 


0.82 ± 0.08 


0.82 ± 0.09 


0.83 ± 0.07 


0.84 ± 0.10 


pi770)-K+ 


a 


1 (fixed) 
(fixed) 


1 (fixed) 
(fixed) 


1 (fixed) 
(fixed) 


1 (fixed) 
(fixed) 




¥ 


(fixed) 


(fixed) 


(fixed) 


(fixed) 




a 


0.57 ± 0.14 


0.48 ± 0.26 


0.59 ± 0.12 


0.49 ± 0.20 


p{U50)-K+ 


a 


0.52 ± 0.15 


0.52 ± 0.16 


0.54 ± 0.13 


0.55 ± 0.22 


$ 


126 ± 25 


90 ± 22 


126 ± 25 


89 ± 22 




$ 


74 ± 19 


74 ± 18 


72 ± 20 


71 ± 21 




a 


0.33 ± 0.15 


0.11 ± 0.31 


0.34 ± 0.13 


0.11 ± 0.31 


p{1700)-K+ 


a 


0.23 ± 0.12 


0.23 ± 0.12 


0.17 ± 0.12 


0.17 ± 0.17 


$ 


50 ± 38 


35 ± 164 


50 ± 34 


34 ± 159 




$ 


18 ± 36 


17 ± 35 


-15 ± 48 


-17 ± 57 




a 


0.66 ± 0.06 


0.66 ± 0.07 


0.67 ± 0.05 


0.68 ± 0.08 


K*{892)+Tv- 


a 


0.49 ± 0.06 


0.49 ± 0.06 


0.55 ± 0.06 


0.54 ± 0.08 


$ 


39 ± 25 


156 ± 25 


40 ± 25 


156 ± 25 




$ 


33 ± 22 


33 ± 22 


172 ± 20 


172 ± 21 




a 


0.57 ± 0.06 


0.57 ± 0.06 


0.58 ± 0.06 


0.58 ± 0.07 


K*{892)%° 


a 


0.49 ± 0.05 


0.49 ± 0.05 


0.50 ± 0.05 


0.51 ± 0.07 


$ 


17 ± 20 


17 ± 21 


17 ± 21 


16 ± 21 




$ 


29 ± 18 


29 ± 18 


9 ± 18 


9 ± 19 




a 


1.15 ± 0.09 


1.22 ± 0.10 


1.18 ± 0.07 


1.24 ± 0.13 




a 


1.24 ± 0.09 


1.24 ± 0.09 


1.32 ± 0.08 


1.33 ± 0.14 


$ 


-130 ± 22 


-19 ± 25 


-130 ± 22 


-19 ± 24 




$ 


-167 ± 16 


-168 ± 16 


-38 ± 18 


-38 ± 19 




a 


0.91 ± 0.07 


1.25 ± 0.10 


0.93 ± 0.07 


1.28 ± 0.13 




a 


0.78 ± 0.08 


0.78 ± 0.09 


1.11 ± 0.07 


1.12 ± 0.11 


$ 


10 ± 17 


21 ± 17 


10 ± 17 


21 ± 17 




$ 


13 ± 17 


13 ± 17 


1 ± 14 


1 ± 14 




a 


0.56 ± 0.08 


0.31 ± 0.09 


0.58 ± 0.08 


0.32 ± 0.10 


NR 


a 


0.62 ± 0.07 


0.63 ± 0.07 


0.57 ± 0.08 


0.58 ± 0.09 


$ 


87 ± 21 


-61 ± 22 


87 ± 21 


-61 ± 22 






48 ± 14 


48 ± 14 


-65 ± 15 


-65 ± 17 
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TABLE IX: Systematic uncertainties associated with the K*it isobar parameters summarized in Table IVlnl under Sol. 

I. Uncertainties in the phases are in degrees. 



Amplitude 




(ria) 


(jia) 




^ V ^ / L J 




Isobar Model 


0.00 


0.00 


16 


19 




B Backgrounds 


0.01 


0.01 


1 


1 




PDF Shape Parameters 


0.03 


0.01 


3 


1 




SCF Fraction 


0.00 


0.00 


1 


1 


7t'*(892)+7r" 


PID Systematics 


0.00 


0.00 





1 




Lineshapes 


0.01 


0.00 


9 


4 




Fit Bias 


0.02 


0.01 


6 


6 




Continuum DP 


0.00 


0.00 


2 


1 




Total 


0.04 


0.02 


20 


20 




Isobar Model 


0.02 


0.02 


19 


36 




B Backgrounds 


0.01 


0.01 


1 


1 




PDF Shape Parameters 


0.04 


0.05 


3 


1 




SCF Fraction 


0.00 


0.00 


1 


1 




PID Systematics 


0.01 


0.01 





1 




Lineshapes 


0.01 


0.01 


8 


3 




Fit Bias 


0.03 


0.03 


6 


6 




Continuum DP 


0.03 


0.03 


4 


5 




Total 


0.06 


0.07 


22 


37 




Isobar Model 


0.02 


0.01 


2 







B Backgrounds 


0.01 


0.01 


1 


1 




PDF Shape Parameters 


0.02 


0.02 


1 


1 




SCF Fraction 


0.00 


0.00 








A'*(892)"7r° 


PID Systematics 


0.00 


0.00 


1 







Lineshapes 


0.01 


0.00 


4 


4 




Fit Bias 


0.01 


0.00 


1 


1 




Continuum DP 


0.01 


0.01 


6 


5 




Total 


0.03 


0.02 


8 


6 






0.02 


0.03 


14 


9 




B Backgrounds 


0.01 


0.02 


1 


1 




PDF Shape Parameters 


0.03 


0.02 


1 


1 




SCF Fraction 


0.00 


0.00 










PID Systematics 


0.00 


0.01 










Lineshapes 


0.01 


0.02 


4 


6 




Fit Bias 


0.01 


0.00 


1 


1 




Continuum DP 


0.01 


0.03 


6 


4 




Total 


0.04 


0.06 


16 


12 
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TABLE X: Systematic uncertainties associated with the ^ p and non-resonant isobar parameters summarized in Ta- 
ble IVllIl under Sol. I. Uncertainties in the phases are in degrees. 



Amplitude 




cri cl) 


(j(cl) 


o-f*) f°l 






Isobar Model 


0.06 


fixed 


fixed 


fixed 




B Backgrounds 


0.01 


fixed 


fixed 


fixed 




PDF Shape Parameters 


0.02 


fixed 


fixed 


fixed 




SCF Fraction 


0.00 


fixed 


fixed 


fixed 




PID Systematics 


0.01 


fixed 


fixed 


fixed 




Lineshapes 


0.01 


fixed 


fixed 


fixed 




Fit Bias 


0.01 


fixed 


fixed 


fixed 




Continuum DP 


0.01 


fixed 


fixed 


fixed 




Total 


0.07 


fixed 


fixed 


fixed 




Isobar Model 


0.04 


0.03 


25 


5 




B Backgrounds 


0.03 


0.04 


1 


1 




PDF Shape Parameters 


0.02 


0.05 


1 


2 




SCF Fraction 


0.00 


0.01 





1 


p(1450)~-R"+ 


PID Systematics 


0.00 


0.02 


1 







Lineshapes 


0.03 


0.02 


5 


5 




Fit Bias 


0.02 


0.01 


2 


4 




Continuum DP 


0.00 


0.02 


1 


3 




Total 


0.07 


0.08 


26 


9 




Isobar Model 


0.01 


0.02 


16 


12 




B Backgrounds 


0.04 


0.02 


2 


3 




PDF Shape Parameters 


0.02 


0.02 


3 







SCF Fraction 


0.01 


0.00 





1 




PID Systematics 


0.00 


0.01 


1 







Line Shapes 


0.04 


0.05 


10 


9 




Fit Bias 


0.02 


0.05 


4 


1 




Continuum DP 


0.00 


0.01 





4 




Total 


0.06 


0.08 


20 


16 




Ttjnrip T" lV/Tr»ri p1 


0.01 


0.00 


13 


I 




B Backgrounds 


0.01 


0.01 


1 


1 




PDF Shape Parameters 


0.04 


0.03 


1 


3 




SCF Fraction 


0.00 


0.00 





1 


NR 


PID Systematics 


0.00 


0.01 





1 




Lineshapes 


0.02 


0.01 


8 


4 




Fit Bias 


0.05 


0.01 


1 


2 




Continuum DP 


0.02 


0.02 


1 


3 




Total 


0.07 


0.04 


15 


6 



TABLE XI: The CP averaged interference fractions, Iki among the intermediate decay amplitudes expressed as a percentage of 
the total charmless decay amplitude. The interference fractions are calculated using the isobar amplitudes given in Table rvTIll 
as solution I. 





p(770)"A'+ 


^(1450)"^-+ 


p{nmyK+ 


A:*(892)+7r- 




a:* (892)%" 


(^^)S%" 


NR 


p{77Q)-K+ 


17.61 


7.22 


0.88 


0.47 


-1.49 


0.50 


-0.78 


0.00 


p(1450)-A'+ 




6.34 


-1.71 


0.60 


0.65 


0.42 


0.97 


0.00 


p(1700)-A'+ 






1.68 


0.22 


-0.72 


0.23 


-0.28 


0.00 


7^*(892) + 7r- 








7.05 


0.00 


-0.05 


-0.10 


0.00 












30.30 


-0.08 


0.34 


-0.08 


A-* (892)%° 












5.87 


0.00 


0.00 
















15.29 


1.16 


NR 
















7.49 
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TABLE XII: Correlation coefficients among the floated isobar parameters for B decays. 





a $ 


a $ 


ii'*(892)+7r- 
a $ 




1.00 -0.07 
-0.07 1.00 


0.65 -0.01 

0.17 0.56 


0.51 -0.06 

0.03 0.94 


{Kn)Q n ^ 


0.65 0.17 
-0.01 0.56 


1.00 0.17 
0.17 1.00 


0.52 0.15 
-0.01 0.51 




0.51 0.03 
-0.06 0.94 


0.52 -0.01 
0.15 0.51 


1.00 0.03 
0.03 1.00 




0.56 0.01 
0.00 0.51 


0.36 -0.04 
0.17 0.86 


0.42 0.00 
-0.01 0.46 


NR " 


0.43 -0.38 
0.07 0.63 


0.15 0.02 
0.18 0.68 


0.37 -0.36 
-0.05 0.53 


p(1450)-K+ ^ 


0.31 -0.19 
0.06 0.52 


0.14 -0.13 
0.11 0.58 


0.20 -0.20 
0.04 0.46 


p(1700)-i^+ I 


0.23 -0.28 
-0.12 0.62 


0.06 -0.20 
0.10 0.56 


0.14 -0.27 
-0.03 0.56 


p{770)-K+ a 


0.56 0.17 


0.56 0.20 


0.45 0.16 



TABLE XIII: Correlation coefficients among the floated isobar parameters for B decays. 





i^*"(892)7r" 
a $ 


NR 
a $ 


p(1450)"is:+ 
a # 


p{1700)~K+ 
a $ 


p(770)-is:+ 
a 




0.56 0.00 
0.01 0.51 


0.43 0.07 
-0.38 0.63 


0.31 0.06 
-0.19 0.52 


0.23 -0.12 
-0.28 0.62 


0.56 
0.17 




0.36 0.17 
-0.04 0.86 


0.15 0.18 
0.02 0.68 


0.14 0.11 
-0.13 0.58 


0.06 0.10 
-0.20 0.56 


0.56 
0.20 


K*{m2) + n- I 


0.42 -0.01 
0.00 0.46 


0.37 -0.05 

-0.36 0.53 


0.20 0.04 

-0.20 0.46 


0.14 -0.03 

-0.27 0.56 


0.45 

0.16 


i^*(892)°7r° ^ 


1.00 -0.09 
-0.09 1.00 


0.25 0.09 
0.00 0.65 


0.27 0.18 
-0.15 0.54 


0.24 -0.10 
-0.14 0.50 


0.42 
0.20 


NR I 


0.25 0.00 
0.09 0.65 


1.00 -0.26 
-0.26 1.00 


0.24 -0.05 
-0.16 0.71 


0.21 -0.23 
-0.22 0.63 


0.27 
0.24 


p(1450)-if+ I 


0.27 -0.15 
0.18 0.54 


0.24 -0.16 
-0.05 0.71 


1.00 0.02 
0.02 1.00 


0.70 -0.67 
0.16 0.46 


-0.10 
0.36 


p(1700)-if+ I 


0.24 -0.14 
-0.10 0.50 


0.21 -0.22 
-0.23 0.63 


0.70 0.16 
-0.67 0.46 


1.00 -0.61 
-0.61 1.00 


-0.01 
0.27 


p{770)-K+ a 


0.42 0.20 


0.27 0.24 


-0.10 0.36 


-0.01 0.27 


1.00 



TABLE XIV: Correlation coefficients among the floated isobar parameters for B decays. 





a <I> 


a $ 


A:*(892)-7r+ 
a $ 


(K7r)r7r+ 1 


1.00 0.09 
0.09 1.00 


-0.44 0.05 
0.01 0.35 


-0.39 0.10 
0.12 0.86 


{K^ro°^° 1 


-0.44 0.01 
0.05 0.35 


1.00 0.47 
0.47 1.00 


0.34 0.02 
0.02 0.28 


/f-(892)-^+ 1 


-0.39 0.12 
0.10 0.86 


0.34 0.02 
0.02 0.28 


1.00 0.14 
0.14 1.00 


F*(892)V° 1 


-0.49 0.01 
0.07 0.34 


0.24 0.03 

0.34 0.80 


0.31 -0.01 

-0.02 0.28 


NR I 


-0.49 -0.25 
-0.09 0.33 


0.25 0.02 
-0.11 0.45 


0.30 -0.23 
-0.08 0.18 


p(1450)+i^- 1 


-0.63 -0.19 
0.02 0.48 


0.41 -0.17 
0.02 0.50 


0.35 -0.18 
0.02 0.37 


p(1700)+i^- 1 


-0.37 -0.17 
0.30 0.49 


0.24 -0.13 
-0.19 0.36 


0.22 -0.16 
-0.14 0.39 
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TABLE XV: Correlation coefficients among the floated isobar parameters for B decays. 





X*(892)%" 
a 3> 


NR 
a $ 


p(1450)+j£:- 
a $ 


p(1700)+/f- 
a ¥ 


{rLivjg II 


-0.49 0.07 
0.01 0.34 


-0.49 -0.09 
-0.25 0.33 


-0.63 0.02 

-0.19 0.48 


-0.37 0.30 

-0.17 0.49 


^A,. )„ ,1 - 


0.24 0.34 
O.l):! ().<S0 


0.25 -0.11 
I). 02 0.15 


0.41 0.02 
-0.17 ().."•)() 


0.24 -0.19 
-O.i:! 0.36 




0.31 -0.02 
-0.01 0.28 


0.30 -0.08 
-0.23 0.18 


0.35 0.02 
-0.18 0.37 


0.22 -0.14 
-0.16 0.39 




1.00 -0.05 
-0.05 1.00 


0.25 0.05 
-0.01 0.49 


0.35 0.03 
-0.23 0.49 


0.23 -0.16 
-0.18 0.35 


NR ^ 


0.25 -0.01 

0.05 0.49 


1.00 -0.05 

-0.05 1.00 


0.31 0.01 

-0.21 0.57 


0.23 -0.20 

-0.23 0.45 


p{U50)+K- 1 


0.35 -0.23 
0.03 0.49 


0.31 -0.21 
0.01 0.57 


1.00 -0.24 
-0.24 1.00 


0.57 -0.72 
0.13 0.47 


p{1700)+K- 1 


0.23 -0.18 
-0.16 0.35 


0.23 -0.23 
-0.20 0.45 


0.57 0.13 
-0.72 0.47 


1.00 -0.49 
-0.49 1.00 



